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The very notion of social network implies that linked individuals interact repeatedly with 
each other. This allows them not only to learn successful strategies and adapt to them, 
but also to condition their own behavior on the behavior of others, in a strategic forward 
looking manner. Game theory of repeated games shows that these circumstances are con- 
ducive to the emergence of collaboration in simple games of two players. We investigate 
the extension of this concept to the case where players are engaged in a local contribution 
game and show that rationality and credibility of threats identify a class of Nash equilibria 
- that we call "collaborative equilibria" - that have a precise interpretation in terms of 
sub-graphs of the social network. For large network games, the number of such equilib- 
ria is exponentially large in the number of players. When incentives to defect are small, 
equilibria are supported by local structures whereas when incentives exceed a threshold 
they acquire a non-local nature, which requires a "critical mass" of more than a given 
fraction of the players to collaborate. Therefore, when incentives are high, an individual 
deviation typically causes the collapse of collaboration across the whole system. At the 
same time, higher incentives to defect typically support equilibria with a higher density of 
collaborators. The resulting picture conforms with several results in sociology and in the 
experimental literature on game theory, such as the prevalence of collaboration in denser 
groups and in the structural hubs of sparse networks. 

The social network influences and constrains in non-trivial ways the behavior of individuals (Jl]) 
but also contributes to aspects generically referred to as social capital ([2 El E|), which favor the 
emergence of coordinated actions or collaboration 1 . 

The theoretical investigation about the emergence of collaboration and the fate of repeated 
actions on networks has, up to now, mostly focused on adaptive learning, imitation and evolutionary 
game theory. The corresponding theoretical models (|6j EHHJ El fTU]) seem to suggest that sustaining 
collaboration is easier on sparse networks and spatial structures than on dense groups. On the 

1 We will explicitly refer to this endogenous profitable mutual exchange as collaboration, and not as cooperation, to 
stress the fact that it emerges from individual opportunistic incentives and not from group-based profit maximiza- 
tion, as in the cooperative games already introduced in 
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contrary, there is no clear experimental evidence of such an effect. Results of recent experiments 
on voluntary contribution suggest instead that the establishment and maintenance of collaboration 
is easier on well connected groups than on sparse graphs (jilt IT^l ITH|) . in some ways confirming 
the intuition behind the classical Coleman's closure argument (|14p . The picture becomes more 
complex as we move to analyze individual positions in the network: Experiments performed on 
star-shaped groups suggest that central nodes are fostered to collaborate more than peripherals 
(|13p . corroborating another well-known idea, i.e. Burt's argument on the importance of structural 
holes (JED. 

However, the network is not only the channel for the achievement of payoffs or the exchange 
of information, which are the key ingredients of learning and imitative behavior. The network 
also supports the establishment of trust, norms, contracts and other continuative collaborative 
relations in which the temporal dimension is crucial. In fact, a key aspect of a social network is 
that individuals connected by a link interact repeatedly with each other, calling into play forward 
looking strategic behavior typical of the theory of repeated games. This provides a formal framework 
for concepts such as threats, punishment and credibility, which have been so enlightening on the 
emergence of collaboration in simple setups (e.g. the prisoner's dilemma) (16). 

Here we investigate the extension of the theory of repeated games to network games. We focus on 
simple local contribution games which provide a perfect framework to highlight the main conceptual 
issues, and are closely linked to experimental works on voluntary contribution (|1H \12\ [T3l ITT)) . 
We start from the assumption, largely verified experimentally (see for instance Ref. (|17p ). that 
collaboration can be sustained only through a reciprocal relation of control and punishment, which 
plays an essential role in the theory of two-person repeated games (16). It follows that collaboration 
becomes conditional, i.e. an agent collaborates only if her peers also collaborate. We show that, 
in a multi-player setting, rationality imposes conditional collaboration to be i) reciprocal and ii) 
player-specific: Controlling only a subset of neighbors is enough to guarantee collaboration, and 
credibility of threats dictates that punishment should be limited to the minimal subset of neighbors 
which supports collaboration as a best response. These requirements identify a refinement of Nash 
equilibria, that we call Collaborative Equilibria, with a precise graph-theoretical interpretation. 
This turns the problem of finding and characterizing Nash equilibria into that of finding specific 
sub-graphs of the social network, which can be addressed by graph theoretical methods (fT8l IT9]) . 
and it provides considerable insight on the nature of possible collaborative structures which can 
be supported, depending on incentives and on the topology of the social network. In particular, we 
find that when the contribution cost is low, collaboration can be sustained by local commitments 
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(corresponding to dimers or loops on the network). But when costs are high, collaboration requires 
non-local structures which span a finite fraction of the system. This has clear implications in terms 
of systemic fragility, because when costs are high a single individual defection may bring to the 
collapse of the whole collaborative network. 

Our analysis of Collaborative Equilibria on ensembles of random graphs unveils a generic picture 
which, as will be discussed in the closing section, has many correspondences with well known results 
in sociology and in experimental economics. 

I. A REPEATED GAME OF LOCAL CONTRIBUTION 

We focus on a class of local contribution games, recently popularized in Refs. (|17( [20]) . which 
have the peculiarity that only the neighbors of a contributor and not the contributor herself benefit 
of the positive effects of a contribution. In this regard, we can interpret these local contribution 
games as a simple extension of the celebrated prisoners' dilemma to the case where there are more 
than two players, where the range of possible interactions between individuals is limited only to 
local ones by a fixed network structure, and where agents play the same strategy against each 
neighbor. 

A. The Model 

Players occupy the nodes N of an undirected social network and they interact with their neigh- 
bors in a local contribution game. Specifically, each player i £ N has the option of either con- 
tributing (sj = 1) or not (sj = 0) to a local public good that has effect only on the neighbors of i 
in Ni? Contributing is costly, which means that players who contribute incur a cost X% > 0. At 
the same time, each player receives a unitary payoff from all agents j £ Ni who contribute in her 
neighborhood. The payoff function of agent i is then given by 



where s_« stands for the vector of choices of all other players, except i. It is clear that, in the single 
stage game, a positive Si is only a cost for player i, and hence defection (i.e. Si = 0) is a dominant 
strategy for all Xi > 0: 7Tj(0, s_j) > 7^(1, s_j). If the game is played just once, the unique Nash 




(1) 



jeNi 



2 We adopt the notation (TV, N) to specify the social network, where N is the set of nodes and the i th element of N, 
denoted Ni, is the subset of the neighbors of i (i S' Ni. The social network is undirected: i £ Nj implies j G Ni). 
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equilibrium is one where s« = for all i S N. When players are engaged in repeated plays of the 
game, with the same opponents, a much richer set of outcomes is possible. Indeed, a continuum 
set of outcomes can be sustained as Nash equilibria §TU\i . 

Let the game above be played repeatedly at discrete times t = 0,1,2,3,... and let sf^ be the 
option taken by agent i at time t. A strategy now becomes an action plan <jj = {sf^ , 4 = 0,1,2,...}, 

which specifies the behavior of agent i at all times. In particular, sf^ may be any function of the 

(t f ) 

opponents' behavior s - in the previous stage games t < t. The payoff function is generalized to 
an inter-temporal utility function 



where 5 S (0, 1] is the factor by which agents discount future payoffs with respect to present ones. 
For (5—7-0 the game reverts to the single stage game with the unique non-collaborative equilibrium. 
The limit S — >■ 1 of (temporally) very far-sighted players is instead much more interesting, because 
players can choose from a huge (a priori infinite) space of possible strategies. 

B. Trigger Strategies 

To attack this problem, we start considering the simpler and well-known situation of a two- 
player game, where enforceable payoffs can be attained as Nash equilibria by reducing the set of 
possible strategies to a particular subset, known as trigger strategies (I2T1) . Trigger strategies encode 

the idea of punishment: agent i collaborates a priori, but if her opponent j misbehaves (i.e. Sj = 

(f) 

for some t > 0), she will punish her with defective behavior for the infinite future (i.e. s\ = 
for all t' > t). If the opponent is "threatened" in this way, her best reply, if 5 is large enough and 
Xi < 1, is to collaborate, or equivalently to use the same trigger strategy. This in fact guarantees 
the collaboration payoff 1 — Xi > in each round, as opposed to the zero payoff she would get if 
both defected. A crucial issue is that threats of punishment must be credible: a rational opponent 
will not consider credible a trigger strategy that inflicts a payoff loss to the player herself. 

How does this insight carries over to multi-player settings, where players interact with their 
neighbors on the network? It is instructive to consider the case of three players, without loss of 
generality call them 1, 2 and 3, all connected together in a closed triangle 3 , with Xi < 1. Imagine 




(2) 



t>o 



3 From now on, for the sake of simplicity and without loss of generality, we focus on the limit 5—^1 where the utility 
is dominated by the asymptotic behavior of players. Each statement derived for S — > 1 will be true for a S < 1, 
which is large enough. 
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that players 1 and 2 are both using trigger strategies, making their collaboration conditional on the 
collaboration of the others. How should player 3 behave? If she takes the threat of other players 
seriously, then she will also collaborate. But should she consider their threat credible? No, because 
if player 3 were to defect, and both 1 and 2 also turn to defection, they would get a payoff of zero, 
whereas if they were to continue collaborating they would get a payoff of 1 — Xi > in each stage 
game. Hence the threat of players 1 and 2 is not credible and player 3 better defects, free-riding 
with a payoff of 2. On the contrary, if we assume Xi > 1 Vi then full collaboration is individually 
rational and can be sustained in the repeated game as a Nash equilibrium outcome by means of 
credible threats. This example points out that generalizing trigger strategies entails making the 
strategies conditional on the behavior of a subset of the players: for Xi < 1, player 1 will punish 
player 2 but not player 3, because only one collaborator is needed in the neighborhood to make 
collaboration the best choice. In other words, control by punishment is play er- specific 4 . 

Also, the same arrangement of players shows that punishment should be reciprocal. Imagine 
a situation where player 1 punishes 2, 2 punishes 3 and 3 punishes 1. Should 3 abide to this 
arrangement? No. Again if she decides to defect, she may argue that it is not credible that 2 will 
punish her, because again 2 would end up with a lower payoff (zero) than what she would get by 
continuing collaborating with 1. 

C. Collaborative Equilibria 

These considerations generalize naturally to a notion of Nash equilibrium sustained by trigger 
strategies for a general network, with the three conditions that punishment must be (1) credible, 
(2) player- specific, and (3) reciprocal. Let a = be the "always defect" strategy and r(A) be a 
trigger strategy, conditional on the behavior of agents j G A C N. An agent playing t(A) will 
collaborate as long as all agents in A also collaborate. Let C C JV be the subset of agents who 
play trigger strategies, whereas agents i ^ C always defect (a = 0). Individuals are only allowed 
to control their neighbors, i.e. if % € C plays r(Aj), then Aj C iVj. It is convenient to introduce 
also the set of punishers of i € C, which is Tj = {j : i E Aj} C C H iVj. Then let q = \C n Ni\ 
be the number of collaborators in z's neighborhood and ji = \Ti\ be the number of punishers of i. 
We assume that agents are (spatially) nearsighted in that, in considering the effect of deviations, 
they only consider direct effects of punishment. Effects due to loops in cascades of defections and 



4 This notion was already implicitly present in several multi-player generalization of the Prisoner's Dilemma intro- 
duced to study the free-riding problem in groups of individuals (122[) . 
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punishments are neglected 5 . Under these assumptions, we define the following refinement of Nash 
equilibria in the repeated local contribution game, 

Proposition 1 (Collaborative Equilibria) The arrangement where, for all i £ C , Xi < 7, < 

Xi + 1 and Ti = Aj, is a Nash equilibrium of the repeated game of nearsighted agents, for a 
sufficiently large discount factor S. 

Proof: If player i G C deviates by defecting, she can expect to receive a payoff per period of q — 7,. 
If this is less than the payoff Cj — Xi she gets by collaborating, then deviation is unprofitable. This 
occurs if ji > Xi, which is the first inequality in the proposition. Now, let i,j € C be neighbors and 
let j g" Ti defect. Then, if i continues to collaborate, her payoff is q — 1 — Xi whereas by defecting 
i gets q — 1 — 7i (note that since j Ti the value of 7$ does not change). If i was collaborating 
before, i.e. if ji > Xi, then i should continue collaborating, which means that % should not punish 
j, i.e. j A, or i Tj. As a consequence i £ Tj implies j 6 Ti, or Tj = Aj, because otherwise the 
argument above would produce a contradiction. Finally, let i E Tj. If j defects, i should punish 
her, i.e. i should also stop collaborating. This means that i's payoff to collaborate (cj — 1 — Xi) 
should be less that the payoff to defect, which is cj — 1 — (7* — 1), because j 6 Tj. This implies 
Ti < Xi + 1 which is the second part of the inequality in the proposition. □ 

Note that the assumption on spatial nearsightedness is not relevant for the incentive to collab- 
orate. In other words, if 7$ > Xi then collaborating would still be the best option if some other 
neighbors of i Ti would also stop collaborating, as a consequence of indirect cascades of punish- 
ments. On the contrary, a situation where players were able to anticipate indirect defections may 
entail non- reciprocal control 6 . Here, the assumption that agents cannot compute indirect effects of 
punishment is crucial. 

Collaborative equilibria are a particular subset of all the Nash equilibria which can be supported 
by trigger strategies 7 . Here we keep the sophistication of the game theoretic treatment to a minimal 

5 The defection of an agent i or of one of its neighbors, could generate a cascade of defections due to punishment, 
which might lead also agents j £ iVj\rj to defect. Such indirect effects of punishment only occur if there are loops 
in the social network. If the social network is a tree, deviation of a neighbor of i cannot have effects on other 
neighbors of i, if not through a change of i's behavior. Hence nearsightedness is equivalent to assuming lack of 
common knowledge beyond the immediate neighborhood: players know only their neighbors and how many players 
each of them is interacting with. 

6 Consider for example the case where j £ Ti defects, and as a result of this k £ 17 also defects in order to punish 
j or some other neighbor. If i continues collaborating she gets c» — 2 — Xi whereas if she defects her payoff is 
d — 2 — (ji — 1). Not punishing is not rational because Ci — 2 — Xi > a — 1 — 7; cannot be satisfied if Xi > 7;. 
Hence i £ Tj. 

7 It is possible to show that these equilibria can be defined as the equilibria of similar games with the same payoffs 
l|23l 12 1 [I . For this we refer to a companion paper (|25[) . 
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level and we focus, instead, on the aspects related to the structure of collaborative equilibria and 
their computational complexity. In this respect, we note that a direct consequence of Proposition 
[T] is that it turns the characterization of Nash equilibria into a graph theoretical problem: 

Corollary 2 Every Collaborative Equilibrium of the local contribution game identifies a subgraph 
(C, r) of the social network (N,N), with C C N , Tj C JVj and being the smallest integer larger 
than Xi. Every subgraph (C,T) with these properties supports a Nash equilibrium where players 
i G C collaborate (s^ = 1) and players not in C defect (sf = 0). 

II. THE COMPLEXITY OF COLLABORATION ON NETWORKS 

How many collaborative equilibria exist on a given social network and how does this number 
depends on the number of players, the payoffs and the network structure? How much hard is 
it to compute an equilibrium? How does the equilibrium "respond" to local perturbations? The 
mapping of collaborative equilibria to collections of possibly disconnected subgraphs of a given 
socio-economic network allows us to address a number of questions. Some of these can be answered 
in very general terms: For example, if < Xi < 1 Vi, the subgraphs which support collaborative 
equilibria are collections of disjoint "dimers" (see Fig. [I] left). The number of dimer covers is 
generically expected to increase exponentially with the size of the network, and local deviations 
have only local effects, as the defection of one player affects at most the behavior of the other player 
on the same dimer. If 1 < X{ < 2 collaborative equilibria coincide with configurations of loops on 
the social network and larger Xi entail more complex structures (see Fig. [T] right). Correspondingly, 
the answer to the questions above becomes non-trivial. Also, the problem of finding subgraphs of 
a given network can be computationally very hard 8 , but it is typically very easy for dimers and 
loops, or for specific classes of graphs, such as planar graphs. 

A. Collaborative Equilibria on Random Graphs 

Quantitative predictions are possible for networks which are drawn from ensembles of random 
graphs. For large network sizes (\N\ — > oo) several properties attain a limit which is independent of 
the particular realization of the social network. We refer to these as typical properties, i.e. properties 
which are expected to hold with high probability for large networks. The local tree-like structure of 

8 For instance, in the case of random regular subgraphs, i.e. Ji = J Vi, the problem is known to be NP-complete on 
general graphs (26 j. 
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FIG. 1 Example of collaborative equilibria for N = 40 players on a regular random graph (|iVj| = K = 4) 
with < Xi < l,Vi (left) and 2 < Xj < 3,Vi (right) ). Defectors are in black whereas collaborators are 
in yellow. Thick links are those between players who collaborate conditionally on each other [i £ Tj and 

j e r<). 



large graphs with a finite degree makes the characterization of typical behavior tractable by means 
of message passing techniques (|19p . such as Belief Propagation (BP), which are exact on trees and 
are approximately correct also for finite, moderately clustered graphs. The theoretical treatment is 
formally the same as in (\'27\ [28" 1 [29"]) . which have considered similar graph-theoretic problems 9 . BP 
allows one to derive results on ensembles of graphs in the limit |iV| — ^ c» (|19p but it also provides 
efficient heuristic algorithms to find collaborative equilibria on given graph instances (1301 31). The 
messages which are exchanged in the BP algorithm are the probabilities = P{i G Tj f] C} 

that player i collaborates and punishes j, in the collaborative equilibrium 10 . These probabilities, 
are updated through the equation ([28|) 



^ = y (3) 



where, for any integer q and subset V Q N, 



z q v ^ = y, i p\= q n n (! - Mk-^) w 

t/cv jet/ fcev/c/ 



9 All results presented here are obtained in the so-called replica-symmetric ansatz, that is under the assumption that 
the statistical properties of the equilibria are described by a unique Gibbs measure. This assumption is not always 
strictly correct, because the organization of the space of solutions could be more complex (JTHJ) . A signature that 
replica-symmetry could be a wrong assumption is provided by the stability of the BP fixed point. On single graph 
instances, this corresponds to the convergence of BP messages. In fact, we have observed that the BP equations 
are not always stable in the full range of values assumed by e. 
10 In the sub-graph problem, this is the probability that the link is part of the sub-graph, in the modified graph 
in which the link from i to j is removed. On trees, this operation disconnects the graph in subtrees. 



9 



and the indicator function I[c/|=q restricts the sum only to subsets of q elements. In words, the 
numerator in the r.h.s. of Eq. Q, which is based on Eq. Q, asserts that i should control j if 
there are 7, — 1 other players k 7^ j who control i. The denominator expresses the fact that, 
in a collaborative equilibrium, three situations are possible: 1) i £ C, and hence i needs not be 
controlled by any neighbor, 2) i £ Tj and i £ C, or 3) i £" Tj and i £ C, i.e. i is already controlled 
by 7j neighbors and does not need to control j. The parameter e £ (—00, +00) is a statistical weight 
for collaborators, which is introduced to bias the distribution over equilibria towards those with a 
higher (e < 0) or lower (e > 0) density of collaborators. The probability P{i £ C} that a player 
i collaborates or the probability P{i £ Tj} that players i,j £ C conditionally collaborate can be 
expressed in terms of the solution {pi^j} of the set of equations (pPJ as follows 



n* s c } = e ~^ 7i (5) 



In practice, Eqs. (|3j)4j) can be iterated on a specific graph, substituting the value /^-v,- with 
the value of the function on the r.h.s., until a fixed point is reached, which is guaranteed to occur 
on tree-like structures (|19p . The fixed point, however, is not unique. Indeed, for any collaborative 
equilibrium (C, V) , binary messages fi^j = lier^ f]c^hj are a solution of the BP equations. These 
"pure strategy" fixed points coexist with an internal solution, akin to a "mixed strategy" fixed point. 
As in similar problems (|29p , the BP iteration converges to the internal solution, and makes possible 
a series of estimates on the statistical properties of the problem. In particular, we can compute the 
number N{p) of collaborative equilibria as a function of the density of collaborators p = \C\/\N\ ~ 
SieiV-^i^ e C } / 1 -ZV" I . For large population size \N\, the number of equilibria is, to leading order, 
exponentially large in \N\, and one can define the entropy function s(p) = lim^^^ ^ log jV(p). 
Similarly, one can study the entropy of collaborative equilibria as a function of other parameters 
of the problem (e.g. costs of contribution) or topological property (e.g. average degree). Moreover, 
simple adaptations of the message-passing algorithm, e.g. by iteratively fixing some variables (BP- 
decimation (j30p ) or by introducing self-consistent biases on the messages (BP-reinfor cement (I3ip ). 
can be used to converge towards specific pure-strategy equilibria. In this respect, varying e allows 
for searching collaborative equilibria with a given average density of collaborators p. 
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B. Results 

A clear picture of the properties of collaborative equilibria can be obtained considering the 
conceptually simple situation of regular subgraphs of random regular graphs. It corresponds to 
assume a uniform cost, i.e. Xi = X Vi, hence 7, = 7 = \X~\, Examples of collaborative 
equilibria obtained by means of the BP-decimation algorithm on a random regular graph of degree 
= K = 4 are reported in Fig. [T] This suggests that the density of collaborators p increases with 
the cost Xi. This conclusion is also supported by the behavior of the entropy s(p), shown in Fig.[2j 
This attains a maximum at a value pt yp of the density of collaborators, which implies that, for 
large \N\, almost all equilibria have p ~ pt yp . Fig. [2] shows that pt yp increases with Xi, suggesting 
that higher costs enforce higher densities of collaborators. This is an apparently counterintuitive 
result that has however a simple explanation in the context of the model. An agent collaborates 
only as long as there are enough neighbors around her that also collaborate, and that would punish 
her defecting if she defects: the higher the cost of collaboration, the more profitable it would be to 
defect, but hence also the more collaborating neighbors are needed to balance this incentive. 

A remarkable feature of Fig. [2] is that while for 7 = 1 and 2 equilibria exist for all densities p 
of collaborators (i.e. s(p) > 0,Vp £ (0,1]), for 7 = 3 equilibria only exist for p > p c ~ 0.8. This 
reflects the fact that for 7 = 1, collaborative equilibria are collections of "dimers" of collaborators 
who reciprocally control each others in pairs. For 7 = 2, equilibria are collections of loops, whose 
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FIG. 3 (Left) Density p typ of collaborators in a typical equilibrium in Erdos-Renyi graphs as function of 
the average degree (k) for x — 0.1 (black circles) and 0.5 (red squares). The inset shows the corresponding 
typical entropies s max = s(p typ ). (Right) Probability Pc{k) (red squares) that a node of degree |JVj| = k 
collaborates in a typical collaborative equilibrium (pt yp ) and low marginal cost (x = 0.05) on an uncorrelated 
scale-free random graph of size \N\ = 5 • 10 3 with degree distribution P(k) cx fc~ 2 ' 5 for 2 < k < 70 (blue 
circles). 

typical size in a sparse random graph is C(log \ N\). For large graphs, collaborative equilibria with 
7i = 1 or 2 can be constructed adding and removing dimers or loops, adjusting the density p in a 
continuous manner in (0, 1]. For 7 = 3, instead, collaboration requires the formation of a regular 
subgraph of degree 3, which is only possible if more than a fraction p c of the nodes are involved. 
Hence collaborative equilibria do not exist for p < p c , and when they emerge (for p > p c ), they are 
exponentially many and they span a large fraction of the network. This has clear implications for 
the systemic stability of collaborative equilibria: while a local deviation for 7 < 3 only entails local 
rearrangements, for 7 > 3 it is likely to cause the collapse of the whole collaborative structure. 
Hence collaborative equilibria acquire a non-local character whereby the fate of agreements in a 
neighborhood depends on what happens in distant regions of the social network. Such systemic 
fragility has its roots in the organization of the space of equilibria. Collaborative equilibria are 
formally obtained as solutions of constraint satisfaction problems (CSP) that belong to the class of 
locked CSP, recently introduced in Ref. (l29p . In these CSP, if one modifies one variable in a solution, 
the rearrangement required to find another solution propagates across the network possibly affecting 
a sizable part of it. Here, for 7 < 3, the shift from a given equilibrium to another one involves the 
rearrangement of at most 0(log \N\) nodes, i.e. a negligible fraction of the system. On the contrary, 
for 7 > 3 the minimal distance between two equilibria is proportional to the number \N\ of nodes. 

All the instances which have been analyzed confirmed the following set of generic features: i) on 
average the typical fraction pt yp of collaborators increases with costs; ii) the absence of equilibria 
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at small densities p for large costs; and Hi) their fragility w.r.t. small perturbations and non-local 
character, for sufficiently large costs. These include Erdos-Renyi and scale free random graphs, with 
fixed costs Xi = X (see also (28)) and with costs of collaboration X{ = x\Ni\ that are proportional 
to the number of neighbors each player interacts with. In the latter case, when the marginal cost x 
is small, equilibria are mainly formed by dimers and loops and can be found for any density p. When 
x is large, non-trivial collaborative equilibria only exist for sufficiently large density of collaborators 
p, reproducing the "critical mass" effect observed in regular random graphs. Interestingly, when 
the marginal cost exceeds a graph-dependent threshold x c (x c ~ 0.79 for Erdos-Renyi random 
graphs with average degree equal to 4), the number of equilibria vanishes in the full range of p (i.e. 
s(p) < 0), suggesting that the only possible equilibria are the all-defect or the fully collaborative 
(for x = 1) ones. 

In addition, we also found that iv) increasing the average degree promotes collaboration on 
average, because denser graphs admit typical equilibria of larger density pt yp of collaborators, as 
shown in Fig. [3^1eft) for Erdos-Renyi random graphs. The monotonic behavior of s(pt yp ) with 
graph density (see the inset) is an evidence of the fact that in denser graphs there are much more 
possible ways of arranging a collaborating subgraph. Finally, we found that v) within a collaborative 
equilibrium, the more neighbors a player has, the more she is likely to collaborate (see Fig. [3] right). 

Social networks are far from being uncorrelated. Therefore it is important to consider the role 
played by degree correlations. To this end, we have generated assortative/disassortative networks 
starting from uncorrelated ones by means of a link-exchange Monte Carlo algorithm proposed in 
Ref. (32). The corresponding curves s(p) computed for a moderate contribution cost x = 0.1 are 
displayed in Fig. |4j Our results suggest that vi) positive degree-correlation favors collaboration 
in that, the number of collaborative equilibria s(p) and the typical fraction of collaborators pt yp 
increases with degree correlation. Remarkably, in strongly disassortative networks, collaboration 
can be suppressed altogether for large p (see Fig. [4]). 

III. DISCUSSION 

Experiments suggest that, apart from a very small fraction of innate altruists, most individuals 
are self-interested, hence they rationally condition their own collaboration to that of their peers 
(j33p . However, in order to sustain conditional collaboration over time in a social group, credible 
punishment is necessary. In a network setting, we find out that agents condition their behavior 
only on those neighbors that are strictly necessary to get a higher payoff from collaborating than 
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FIG. 4 Entropy s(p) as a function of density p of collaborators on correlated scale-free random graphs. We 
first considered an uncorrelated network ( J = in Eq. 9 of Ref. ([32|) ) of \N\ = 5 • 10 3 nodes, with degree 
distribution P(k) oc fc~ 2 - 5 for 2 < k < 70 (black line and •). Then we generated assortative/disassortative 
networks from this network, by means of a link-exchange Monte Carlo algorithm proposed in Ref. (|52"|) . with 
positive (J = 0.1, triangles) and negative (J = —1, squares) degree-correlation. The cost is Xi = x\Ni\ with 
x = 0.1. 

from defecting, i.e. punishment is player-specific. Immediately we find that control relationships 
between the agents have also to be reciprocal. Reciprocity is a familiar concept in the context of 
repeated games, especially in evolutionary game theory. In this respect, it is worth noting that 
our conditions to sustain collaboration completely agree with the concept of "network reciprocity" 
introduced by Ohtsuki et al. although resulting from a different assumption from our forward- 
looking rationality. Moreover, collaborative equilibria define a subgraph of pairwise interactions that 
reminds endogenous network formation games, in which stable coalitions depend on the existence 
of reciprocal pairwise interactions (|34( [35]) . Simply enforcing these three assumptions by means of 
trigger strategies on a repeated local contribution game on networks, we obtain our main conceptual 
result: collaboration can be described in terms of a purely graph theoretical problem. We have called 
"collaborative equilibria" the corresponding class of Nash equilibrium refinements. 

This approach shows that the contribution cost (incentive to defect) has a major effect on 
the structure of the equilibria. When it is small, agents exert a low control on the neighbors and 
collaboration can be easily sustained in a repeated game. Increasing the cost/incentive, the system 
develops strong long-range correlations and collaboration may require a critical mass. Here, the 
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absence of equilibria with low density of collaborators evokes Oliver and Marwell's "critical mass 
theory", which is one of the most celebrated theories of collective actions (36). This maintains 
that simultaneous coordination of a sufficiently large subset of individuals is one of the possible 
solutions of the free-riding problem in situations in which individual contribution is extremely 
disadvantageous. Here we show that the existence of a critical mass emerges naturally from simple 
interaction, without the need of artificially introducing a threshold in the behavior of the agents. 
In this cases, collaboration is very fragile and, even if there are exponentially many equilibria, 
learning to coordinate on one of them can be very difficult. 

An important conclusion from our analysis, that partially contradicts results from evolutionary 
game theory and learning dynamics based on imitation ([9] [TO]) , is that network's sparseness and 
degree fluctuations do not necessarily favor the emergence of collaboration. In fact, the set of 
constraints imposed by control-and-punishment relations can be much more difficult to satisfy in 
sparse graphs than in dense groups. This is somehow in agreement with experimental observation 
(jilt [13]) , that measured systematically higher contribution levels in cliques and dense groups than 
in circular or linear arrangements. 

The analysis of collaborative equilibria on different topologies suggests that the global prop- 
erties of typical collaborative equilibria do not change considerably on different sparse networks. 
However, the local properties inside a network can be very different. This is evident in heteroge- 
neous networks, where high-degree nodes have a considerably larger probability to collaborate than 
low degree ones. The result is in agreement with predictions of evolutionary game theory (|10p and 
with experimental results obtained comparing the contribution levels of central and peripheral 
nodes in star-like graphs (|13p . It also reminds the idea, firstly proposed by Haag and Lagunoff 
(j37p . of the existence of an uncollaborative fringe of agents connected to a collaborative core that 
can tolerate them. This picture is particularly true when considering heterogeneous networks with 
assortative mixing. On the contrary, in networks with negative degree correlations collaboration 
can be problematic, because of the mismatch between the conditions on high-degree nodes and the 
neighboring low-degree ones. 

We conclude with a note on a recent experiment (138]) on the absence of social contagion with 
respect to collaborative behavior. Social contagion refers to the idea (20) that some personal 
behaviors (as the inclination to collaborate) may be transmitted via social networks. Suri and 
Watts (|38p find that increasing the number of collaborating neighbors does not directly imply a 
larger probability to collaborate (and vice versa). Our model provides a theoretical foundation 
for such an observation. In fact, strategic conditional collaboration requires a precise number of 
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collaborating neighbors and when the level of collaboration in the neighborhood is too high the 
temptation to free-ride takes over. On the other hand, for sufficiently large costs, a collaborative 
state can be destroyed because of a single deviation, that may induce a cascade effect over the 
network. 

In summary, we have put forward a new framework to study the emergence of collaboration on 
networks, that is completely based on assumptions drawn from the experimental observations and 
on a rational forward-looking strategic behavior. Our results provide a theoretical explanation to 
a series of important empirical facts, and could motivate other experiments on repeated voluntary 
contribution games in networked systems. It provides insights in the analysis of strictly strategic 
problems, such as coalition formation, contractual agreements, and negotiation. 
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